A deterministic algorithm that emulates learning with random weights

نویسندگان
چکیده

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A deterministic algorithm that emulates learning with random weights

The expectation of a function of random variables can be modeled as the value of the function in the mean value of the variables plus a penalty term. Here, this penalty term is calculated exactly, and the properties of different approximations are analyzed. Then, a deterministic algorithm for minimizing the expected error of a feedforward network of random weights is presented. Given a particul...

متن کامل

Ergodic averages with deterministic weights

i.e., there exists a constant C such that SN(θ, u) ≤ CN . We define δ(θ, u) to be the infimum of the δ satisfying H1 for θ and u. About H1, in the case where θ takes its values in U (the set of complex numbers of modulus 1), it is clear that for all sequences θ and u, δ(θ, u) is smaller than or equal to 1 and it is well-known (see [Ka] for example) that it is greater than or equal to 1/2. Few e...

متن کامل

An iterative learning algorithm for feedforward neural networks with random weights

Feedforward neural networks with random weights (FNNRWs), as random basis function approximators, have received considerable attention due to their potential applications in dealing with large scale datasets. Special characteristics of such a learner model come from weights specification, that is, the input weights and biases are randomly assigned and the output weights can be analytically eval...

متن کامل

On Random Weights and Unsupervised Feature Learning

Recently two anomalous results in the literature have shown that certain feature learning architectures can yield useful features for object recognition tasks even with untrained, random weights. In this paper we pose the question: why do random weights sometimes do so well? Our answer is that certain convolutional pooling architectures can be inherently frequency selective and translation inva...

متن کامل

FADO: A Deterministic Detection/Learning Algorithm

This paper, proposes and studies a detection technique for adversarial scenarios (dubbed deterministic detection). This technique provides an alternative detection methodology in case the usual stochastic methods are not applicable: this can be because the studied phenomenon does not follow a stochastic sampling scheme, samples are high-dimensional and subsequent multiple-testing corrections re...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Neurocomputing

سال: 2002

ISSN: 0925-2312

DOI: 10.1016/s0925-2312(01)00695-6